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ABSTRACT 

A  number  of  results  were  obtained  pertaining  to  signal  detection 
and  block  truncation  coding  for  Image  compression.  These  results  led 
to  improved  performance  over  previous  approaches,  with  special  attention 
given  to  methods  which  required  less  statistical  knowledge  and  which 
were  easier  to  implement.  In  particular,  use  of  robustness  techniques 
was  employed  to  allow  the  exploitation  of  whatever  knowledge  was  avail¬ 
able,  while  retaining  Insensitivity  to  the  remaining  inexactness  in 
knowledge.  In  addition,  because  the  presence  of  dependency  in  the 
underlying  random  processes  often  complicates  detector  design, 
investigations  Into  when  weak  dependency  could  be  ignored  were  under¬ 
taken.  Finally,  some  results  were  obtained  which  allowed  relaxing 
statlonarlty  assumptions  which  were  placed  on  the  signal  in  earlier 
work. 
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SUMMARY  OF  RESEARCH 


The  research  supported  by  Grant  AF0SR-82-0033  was  primarily  con¬ 
cerned  with  signal  detection,  however  some  effort  was  also  directed 
toward  the  area  of  block  truncation  coding  for  image  compression. 

Results  obtained  pertaining  to  the  latter  will  be  summarized  first. 

Block  truncation  coding  (BTC)  is  a  technique  for  image  compression 
which  is  easy  to  implement  and  often  possesses  good  performance 
characteristics,  relative  to  other  approaches,  even  in  the  presence  of 
many  channel  errors.  Furthermore,  the  BTC  algorithm  does  not  depend 
on  knowledge  of  the  specific  underlying  statistical  distributions,  but 
rather  on  sample  moments.  The  basic  BTC  technique  employs  a  two  level 
quantizer  whose  output  levels  are  obtained  by  matching  sample  moments. 

The  quantizer's  threshold  is  either  taken  a  priori  to  equal  the  sample 
mean  (and  thus  the  output  levels  are  chosen  so  that  the  first  two 
sample  moments  are  preserved),  or  the  threshold  is  chosen  so  as  to 
preserve  a  third  sample  moment.  The  latter  approach,  while  somewhat 
more  complicated  to  Implement,  often  yields  improved  performance  since 
three  moments  are  preserved  instead  of  two. 

The  developers  of  the  technique  presented  formulas  specifying  the 
quantizer  threshold  and  output  levels  so  that  the  first  three  sample 
moments  were  supposedly  preserved.  Unfortunately,  however,  the  formula 
specifying  the  quantizer  threshold  contained  an  error,  and  one  result 
we  therefore  obtained  was  a  correction  of  this  quantity.  Moreover,  the 
developers  of  the  technique  noted  that  rounding  a  certain  quantity  to  an 
Integer  was  at  times  necessary  In  practice;  however,  there  existed 
ambiguity  in  precisely  at  what  point  In  the  algorithm  the  rounding 
should  occur.  We  therefore  Investigated  the  perturbation  of  the  relevant 
quantity,  and  found  that  It  was  fortunately  preferable  from  the  standpoint 
of  all  three  moments  for  the  rounding  to  be  done  consistently  in  one  way. 
We  furthermore  Investigated  the  effects  of  rounding  the  quantity  on  the 
performance  and  noted  that  for  very  many  cases  It  should  not  be  serious. 
These  results  were  delineated  In  #7  of  the  publication  list. 

Noting  that  the  BTC  approach  preserves  sample  moments  (two  moments 
with  one  method  and  three  with  the  other),  we  also  investigated  whether 


or  not  Improved  performance  could  be  obtained  by  employing  moments  other 
than  the  first  two  or  three.  We  found  that  the  original  BTC  scheme  could 
be  generalized  to  yield  a  family  of  moment  preserving  quantizers  using 
higher  sample  moments.  In  particular,  we  found  closed  form  expressions 
for  the  quantizer  output  levels  which  preserved  the  n-th  and  2n-th 
moments  when  a  threshold  equal  to  the  Ln  norm  of  the  samples  was  employed; 
we  also  found  closed  form  expressions  specifying  the  quantizer  output 
levels  and  threshold  which  preserved  the  n-th,  2n-th,  and  3n-th  moments. 

We  then  applied  these  results  to  various  example  images  and  found  that 
Improvement  in  performance  was  obtainable  by  the  use  of  higher  moments, 
both  from  the  standpoint  of  mean  absolute  and  mean  squared  error.  Finally, 
we  noted  that  there  was  a  subclass  of  this  family  of  moment  preserving 
quantizers  for  which  practical  difficulties  In  Implementation  exist;  we 
then  showed  that  frequently  this  subclass  could  be  avoided  to  still  obtain 
good  performance.  These  results  were  delineated  In  #1  and  #10  of  the  publi¬ 
cation  list. 

A  number  of  results  pertaining  to  the  detection  of  signals  In  non- 
Gaussian  noise  were  obtained.  For  example,  a  classical  detector  of  time 
varying  deterministic  signals  In  dependent  noise  Is  the  matched  filter, 
which  maximizes  the  output  signal  to  noise  power  ratio;  It  Is  also 
Neyman-Pearson  optimal  In  the  particular  case  when  the  noise  Is  Gaussian. 

In  many  situations  It  Is  reasonable  to  expect  that  the  signal  will  be  known 
at  discrete  instants,  thus  admitting  the  design  of  the  discrete  time  matched 
filter.  However,  It  Is  often  a  very  different  matter  to  assume  that  the 
signal  will  be  known  exactly  as  a  closed  form  analytical  expression  over, 
for  example,  an  Interval  of  time,  which  would  be  necessary  for  the  design 
of  a  matched  filter  In  continuous  time.  While  the  signal  may  thus  be 
Incompletely  known.  It  Is  reasonable  to  expect  that  In  many  cases  It  could 
be  modeled  as  bandllmlted.  If  we  furthermore  assume  the  signal  Is  known 
at  a  fixed  number  of  Instants,  we  might  hope  that  a  continuous  time  filter 
could  be  designed  which  would  be  Insensitive  to  the  remaining  Inexactness 
In  our  knowledge  of  the  signal.  Such  a  filter  might  also  have  the  potential 
for  Improved  performance  over  the  discrete  time  filter.  Using  a  saddlepolnt 
criterion,  we  obtained  a  result  which  specified  the  form  of  such  a  filter. 


We  then  showed  that  the  saddlepolnt  criterion  did  indeed  impart  robustness 
Into  the  filter;  in  fact,  the  output  signal  to  noise  power  ratio  was  shown 
to  be  invariant  over  all  appropriate  continuous  time  signals  considered. 
Moreover,  we  also  showed  that  the  performance  (as  measured  by  output  signal 
to  noise  power  ratio)  of  this  robust  continuous  time  filter  upper  bounded 
that  of  the  discrete  time  filter.  Finally,  we  showed  by  way  of  example 
that  strict  Improvement  In  performance  over  the  discrete  time  filter  was 
possible.  Employment  of  continuous  time  would  thus  seem  to  be  useful  even 
In  some  cases  which  appear  appropriate  to  discrete  time.  These  results 
were  delineated  In  #8  of  the  publication  list. 

We  also  Investigated  a  situation  where  inexact  knowledge  of  the 
statistics  of  the  noise  was  present  for  the  discrete  time  detection  of 
time  varying  deterministic  signals  in  1.1. d.  non-Gaussian  noise.  In 
earlier  work  employing  the  canonical  form  of  the  locally  optimal  detector, 
some  other  authors  showed  how  the  design  of  the  asymptotically  robust 
detector  for  the  Huber-Tukey  mixture  class  of  noises  could  be  obtained. 

As  might  have  been  expected,  the  results  led  to  censoring  the  factors  of 
the  test  statistic  to  impart  robustness,  which  led  to  the  employment  of 
a  detector  nonlinearity  which  limited  observations  of  large  magnitude. 
However,  this  work  did  not  take  Into  account  the  common  situation  where 
more  Is  known  about  a  noise  density  near  the  origin  than  on  the  tails. 

In  fact,  the  noise  often  arises  In  practice  from  the  sum  of  a  number  of 
"nearly"  Independent  sources,  and  thus  frequently  the  noise  density 
resembles  the  Gaussian  near  the  origin  but  may  differ  markedly  on  the  tails. 
Such  knowledge  had  the  potential  to  be  exploited  for  Improved  performance, 
where  the  robustness  Is  Imparted  to  account  for  our  lack  of  knowledge  of 
the  tails  of  the  noise  density.  We  investigated  this  situation  and  obtained 
results  which  specified  an  asymptotically  robust  detector  for  the  case  where 
the  noise  density  was  known  on  an  Interval  about  the  origin.  We  then  showed 
by  way  of  example  that  the  approach  led  to  Improved  performance  over  the 
previous  one;  In  fact,  the  Improvement  was  quite  dramatic  in  certain  cases. 
These  results  were  delineated  In  #2  of  the  publication  list. 

In  addition,  we  considered  the  discrete  time  robust  detection  of  a  known 
constant  signal  In  additive  Independent  and  Identically  distributed  nominally 
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Laplace  noise.  The  heavy  tailed  nature  of  the  Laplace  density  function 
makes  It  a  popular  model  for  such  non-Gaussian  noise  as  that  encountered 
In  atmospheric  or  undersea  environments.  We  observed  that  applying  some 
existing  results  of  Huber  allowed  deducing  the  form  of  the  test  statistic 
as  a  censored  version  of  the  test  statistic  which  is  Neyman-Pearson  optimal. 
Since  the  performance  of  robust  detectors  is  an  important  subject  which  has 
been  largely  unexplored,  we  pursued  such  an  investigation  with  the  hope  of 
exploiting  the  often  tractable  Laplace  model  for  the  nominal  distribution. 

We  were  able  to  obtain  closed  form  solutions  for  the  distribution  of  the 
censored  test  statistic  under  both  hypotheses,  with  the  result  that  the 
performance  could  be  measured  via  receiver  operating  characteristic  curves 
which  plotted  detection  probability  versus  false  alarm  rate.  Such  curves 
were  then  determined  for  various  cases  of  interest.  A  comparison  of  these 
curves  with  those  for  the  Neyman-Pearson  optimal  case  was  then  performed, 
thus  showing  the  effect  of  various  degrees  of  contamination  of  the  nominal 
distribution  on  the  performance  of  the  robust  detector  when  compared  to 
the  Neyman-Pearson  optimal  one.  These  results  were  delineated  in  #4  of  the 
publication  list. 

The  area  of  memoryless  discrete  time  detection  of  signals  in  ^-mixing 
noise  has  been  studied  by  us  In  the  past  for  both  the  case  when  the  signal 
was  constant  and  when  it  was  also  a  random  process.  The  detector  structure 
employed  consisted  of  a  memoryless  nonlinearity  followed  by  an  accumulator 
and  threshold  comparator,  which  was  Neyman-Pearson  optimal  in  the  independent 
noise  case.  Using  the  criterion  of  asymptotic  relative  efficiency,  these 
earlier  results  accounted  for  the  dependency  by  specifying  the  detector  non¬ 
linearity  which  optimized  performance.  This  nonlinearity  appeared  as  the 
solution  of  an  Integral  equation  which  unfortunately  involved  second  order 
statistics  of  the  random  processes  present.  Since  such  statistical  knowledge 


may  often  be  Incomplete,  we  Investigated  alternative  approaches  which  required 
less  statistical  knowledge  and  which  were  easy  to  Implement. 

For  example,  we  considered  the  detection  of  a  constant  signal  in  weakly 
dependent  ♦-mixing  noise  using  two  approaches.  For  the  first,  the  locally 
optimal  detector  was  employed,  resulting  In  the  need  to  know  only  the  uni¬ 
variate  noise  density.  Since  this  approach  Ignores  the  dependency,  it  is  of 
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course  Important  to  inquire  into  its  performance.  We  therefore  obtained 
a  bound  on  the  degradation  in  performance  which  was  expressed  in  terms 
of  the  ^-representation  of  the  noise.  This  bound  showed  quantitatively 
how  close  the  performance  of  the  locally  optimal  detector  was  to  optimal 
for  various  ^-representations.  The  second  approach  considered  a  more 
general  form,  consisting  of  the  locally  optimal  nonlinearity  plus  a  linear 
correction  term.  Such  a  structure  has  been  shown  to  yield  improved  per¬ 
formance  under  a  moving  average  weak  dependence  model.  We  then  showed 
that  in  the  much  more  general  <i>-mixing  case,  such  improved  performance  is 
unfortunately  not  possible  uniformly  over  the  class  of  noise  processes 
possessing  a  given  ^-representation.  In  fact,  for  any  appropriate 
♦-representation,  we  showed  that  there  must  exist  such  a  process  for  which 
the  locally  optimal  detector  outperforms  the  one  with  the  linear  correction 
term.  Because  of  this  result,  we  might  in  practice  simply  wish  to  employ 
the  locally  optimal  detector  in  the  absence  of  the  required  statistical 
knowledge.  These  results  were  delineated  in  #6  of  the  publication  list. 

We  also  considered  an  alternative  approach  which  was  applied  to 
memoryless  discrete  time  detection  of  random  signals  in  noise,  where  in 
this  case  both  the  signal  and  noise  were  random  processes  (not  necessarily 
independent  of  each  other)  whose  maximal  correlation  coefficient  sequences 
were  summable.  Such  processes  are  strong  mixing,  moreover  this  class  in¬ 
cludes  as  a  proper  subset  the  class  of  ♦-mixing  processes.  In  some  earlier 
work  we  showed  that  the  asymptotically  optimal  nonl inearl ity  again  satis¬ 
fied  an  Integral  equation,  which  in  this  case  Involved  second  order  statis¬ 
tics  of  both  the  signal  and  the  noise.  Noting  that  finding  an  exact  solu¬ 
tion  was  often  limited  in  practice  by  the  numerical  techniques  employed  as 
well  as  the  expected  inexact  statistical  knowledge,  it  was  concluded  that 
the  actual  nonlinearity  obtained  was  only  approximately  optimal.  We  there¬ 
fore  wondered  whether  other  approximations  might  offer  certain  advantages, 
and  thus  pursued  an  Investigation  into  the  general  problem  of  approxi" 
mating  a  detector  nonlinearity.  This  led  to  a  result  which  established 
sufficiency  conditions  for  the  performance  of  a  sequence  of  approximations 
to  converge  to  the  performance  of  a  given  detector.  We  then  applied  these 
conditions  to  the  case  where  the  optimal  detector  nonlinearity  was  approxi¬ 
mated  by  a  quantizer  or  by  a  polynomial.  Our  results  specified  the  form  of 


the  optimal  M-level  quantizer;  moreover.lt  was  shown  that  the  performance 
of  the  resultant  detector  converged  to  optimal  as  the  number  of  quanti¬ 
zation  levels  approached  Infinity.  Since  one  may  be  Interested  in  quanti¬ 
zing  to  Implement  the  detector  digitally,  the  use  of  such  quantizers  might 
be  attractive.  We  also  specified  the  form  of  the  optimal  polynomial  of  a 
given  degree,  and  found  that  it  could  be  obtained  simply  by  solving  a  set 
of  linear  equations  which  involved  joint  moments  rather  then  densities. 

We  then  showed  that  for  a  large  class  of  noises  the  resultant  detector's 
performance  converged  to  optimal  as  the  degree  of  the  polynomial  approached 
infinity.  Because  of  these  convergence  results,  we  therefore  concluded 
that  the  employment  of  a  quantizer  or  polynomial  detector  allowed  per¬ 
formance  arbitrarily  close  to  optimal.  These  results  were  delineated  in  #9 
of  the  publication  list. 

As  with  much  work  which  deals  with  memoryless  detection,  the  results 
described  above  were  obtained  In  conjunction  with  statlonarity  assumptions 
which  were  Imposed  on  the  signal .  Because  there  are  many  cases  where  a 
statlonarity  assumption  regarding  the  signal  may  not  be  appropriate  due  to, 
for  example,  manmade  factors  affecting  the  signal,  we  then  sought  to  investi¬ 
gate  applications  of  memoryless  discrete  time  detection  to  the  case  of  a 
time  varying  deterministic  signal  in  dependent  non-Gausslan  noise.  Using 
the  criterion  of  asymptotic  relative  efficiency,  we  first  specified  the 
form  of  the  optimal  detector  for  the  case  when  the  detector  class  considered 
consisted  of  a  time  Invariant  memoryless  nonlinearity  followed  by  an  accumu¬ 
lator  and  threshold  comparator,  the  same  detector  class  considered  by  us 
In  other  contexts  for  various  stationary  signal  cases.  Having  noted  that 
the  nonstatlonarlty  of  the  signal  might  make  appropriate  a  different 
detector  model,  we  then  employed  a  model  which  Included  a  time  varying 
memoryless  nonlinearity.  We  again  specified  the  form  of  the  optimal  de¬ 
tector  for  this  detector  class.  Several  specific  examples  were  considered, 
and  graphs  of  the  appropriate  optimal  nonllnearltles  were  provided.  We  then 
evaluated  the  asymptotic  performance  of  the  optimal  detectors  of  the  two 
classes,  and  It  was  seen  that  for  the  examples  considered  the  time  varying 
nonlinearity  led  to  superior  performance.  Finally,  in  order  to  reduce 
the  amount  of  statistical  knowledge  of  the  noise  required  for  the  design 
of  the  detector,  an  approach  was  presented  which  Involved  employing  poly- 
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nonrial  approximations  of  the  nonlinearities  of  interest.  Graphs  were 
then  obtained  of  the  optimal  polynomials  of  a  given  degree  for  various 
examples.  These  results  were  delineated  in  #3  of  the  publication  list. 

Finally,  we  observed  that  in  order  to  obtain  improved  performance  it 
might  be  desirable  to  allow  the  detector  to  possess  memory.  The  presence 
of  a  nonstationary  signal  in  conjunction  with  a  dependent  noise  process 
often  complicates  the  design  of  the  detector;  moreover,  in  some  such  cases 
applications  of  known  approaches  which  account  for  the  noise  dependency 
are  inhibited  by  lack  of  knowledge  of  the  higher  order  noise  statistics. 

If  the  noise  dependency  were  weak  the  temptation  to  ignore  it  might  there¬ 
fore  arise.  We  were  thus  led  to  consider  the  discrete  time  detection  with 
memory  of  time  varying  deterministic  signals  in  weakly  dependent  noise.  We 
investigated  quantitative  conditions  which  allowed  determining  when  the 
dependency  could  be  ignored,  and  presented  a  result  which  allowed  bounding 
the  variation  in  false  alarm  rate  and  detection  probability  induced  by 
ignoring  the  dependency.  The  case  of  stationary  Gaussian  noise  was  then 
considered,  and  we  showed  that  our  result  related  the  bound  on  the  variation 
in  false  alarm  rate  and  detection  probability  to  the  rate  of  descent  of  the 
noise  autocorrelation.  These  results  were  delineated  in  #5  and  #11  of  the 
publication  list. 
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DIRECTIONS  OF  CURRENT  RESEARCH 


Current  research  is  directed  toward  the  areas  of  signal  detection 
and  block  truncation  coding  for  image  compression.  Most  of  this  work 
has  as  a  goal  the  admission  of  non-Gaussian  processes  with  dependency. 

In  addition,  we  are  heavily  interested  in  approaches  which  require  only 
moderate  amounts  of  statistical  knowledge,  thus  yielding  greater  utility 
in  practice.  This  is  resulting  in  the  attractiveness  of  robust  or 
nonparametric  schemes.  Because  in  many  cases  we  might  expect  the  presence 
of  dependency  in  the  underlying  random  processes,  we  are  particularly 
interested  in  studying  robust  or  nonparametric  schemes  with  application  to 
dependent  processes.  These  are  areas  for  which  few  results  exist  in  the 
dependent  non>Gaussian  case,  and  thus  the  employment  of  unconventional 
techniques  might  be  necessary. 
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